Hybrid Graph Neural Networks for Few-Shot Learning
نویسندگان
چکیده
Graph neural networks (GNNs) have been used to tackle the few-shot learning (FSL) problem and shown great potentials under transductive setting. However inductive setting, existing GNN based methods are less competitive. This is because they use an instance as a label propagation/classification module, which jointly meta-learned with feature embedding network. design problematic classifier needs adapt quickly new tasks while does not. To overcome this problem, in paper we propose novel hybrid (HGNN) model consisting of two GNNs, prototype GNN. Instead propagation, act adaptation modules for quick tasks. Importantly designed deal fundamental yet often neglected challenge FSL, that is, only handful shots per class, any would be sensitive badly sampled either outliers or can cause inter-class distribution overlapping. Extensive experiments show our HGNN obtains state-of-the-art on three FSL benchmarks. The code models available at https://github.com/TianyuanYu/HGNN.
منابع مشابه
Few-Shot Learning with Graph Neural Networks
We propose to study the problem of few-shot learning with the prism of inference on a partially observed graphical model, constructed from a collection of input images whose label can be either observed or not. By assimilating generic message-passing inference algorithms with their neural-network counterparts, we define a graph neural network architecture that generalizes several of the recentl...
متن کاملImitation networks: Few-shot learning of neural networks from scratch
In this paper, we propose imitation networks, a simple but effective method for training neural networks with a limited amount of training data. Our approach inherits the idea of knowledge distillation that transfers knowledge from a deep or wide reference model to a shallow or narrow target model. The proposed method employs this idea to mimic predictions of reference estimators that are much ...
متن کاملPrototypical Networks for Few-shot Learning
A recent approach to few-shot classification called matching networks has demonstrated the benefits of coupling metric learning with a training procedure that mimics test. This approach relies on an attention scheme that forms a distribution over all points in the support set, scaling poorly with its size. We propose a more streamlined approach, prototypical networks, that learns a metric space...
متن کاملGaussian Prototypical Networks for Few-Shot Learning on Omniglot
We propose a novel architecture for k-shot classification on the Omniglot dataset. Building on prototypical networks, we extend their architecture to what we call Gaussian prototypical networks. Prototypical networks learn a map between images and embedding vectors, and use their clustering for classification. In our model, a part of the encoder output is interpreted as a confidence region esti...
متن کاملBayesian Neural Networks for K-Shot Learning
This thesis introduces multiple extensions and improvements to the probabilistic framework for k-shot image classification proposed by Bauer et al. [2017]. The aim of their framework is to transfer knowledge from a classifier trained on a large dataset to new classes with few training examples. We address three key considerations in this setting: the effectiveness of the weights-based concept t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i3.20226